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In response to consumer concerns about the sustainability of Australian-sourced seafood we derive 
a set of criteria within an explicit decision-process that can be used to determine whether locally 
farmed and wild-caught Australian seafood products meet standards of ecological sustainability and 
Ecologically Sustainable Development.These criteria substantially address the ecological deficiencies 
we identified in other systems commonly used for assessing seafood sustainability.The criteria address 
the issues that are relevant to local seafood production, and are populated with indicators (metrics) 
and benchmarks relevant to the Australian context.The indicators establish performance thresholds 
drawn from public domain data about the products, including observed empirical data and proxies, and 
include default decisions to be applied in the absence of adequate information.This decision structure 
is set within a peer-reviewed expert jury decision-making process.The criteria, decision process and 
decision outcomes from assessment of a number of pilot products were tested in a real seafood 
market (Melbourne), where we found a high level of producer, reseller and consumer acceptance of 
the judgements and ratings.The use of ecologically-derived standards results in several outcomes that 
differ from those of other seafood assessment systems, especially those assessments more focused 
on production standards, such as government, industry and NGO-supported programs, popularly used 
in Australia and worldwide. We conclude that despite high levels of uncertainty surrounding many of 
the population parameters, ecological patterns and processes, empirical cost-effective proxies can be 
used to reasonably estimate a form of sustainability that matches consumer interests/expectations for 
production of fresh local seafood. Despite the plethora of industry and government programs, there 
remains a significant but presently unmet consumer demand for ecologically-based, technically robust, 
independently derived, and readily available information about the local sustainability attributes of 
Australian wild-caught and farmed fresh seafood. 


Key words: aquaculture, ecological integrity, ESD, expert panel, seafood rating system, small-scale fisheries 

DOI: http://dx.doi.org/10.7882/AZ.2016.016 


Introduction 

The ecosystems and habitats of the world’s coastal 
oceans are under many pressures (MEA 2005), and 
in Australia as elsewhere this includes the pressures 
imposed by wild'catch fishing and aquaculture systems 
(SEC 2011; Gascuel et al 2016). The production 
from Australia’s fisheries is in persistent decline, and 
may be related to decline in environment quality 
and increased fishing pressures in some places 
(Ward 2014). In wild'catch fisheries, the decline 


in production is a trend that has persisted across 
many of the fished species in recent decades—Australia’s 
total wild catch production was 223,000 t in 1997'98 
(Caton and McLoughlin 2000), but declined to 15 7,0001 
in 2012'13 (Stephan and Hobsbawn 2014). Currently, 
the largest wild'catch fishery is the Australian sardine 
fishery, in southern waters adjacent mainly to NSW, 
Victoria, South Australia and Western Australia, with 
a 2012'13 catch of 38,000 t, declining from the peak 


2017 ^ UStra ^ioo/ogist volume 39 (I) 

Theme Edition: Zoology on the Table 






Ward et al. 


catch of 47,000 t in 2004^05 (Flood et al 2014), 
mainly fished for aquaculture feed and pet food. In 
contrast, there has been a substantial increase in 
farmed Australian seafood over the last 10 years, 
principally farmed Atlantic Salmon from Tasmania and 
Southern Bluefin Tuna from South Australia, although 
other farmed products have been either steady or in 
decline (Stephan and Hobsbawn 2014). 

The impacts of wild fishing and farming native marine 
species are complex and highly uncertain, and although 
Australia’s fishery and aquaculture management practices 
strive to be highly precautionary, there remain many issues 
that are yet to be resolved. Central uncertainties include 
the widespread use of production objectives to set approved 
levels of catch from wild fisheries, and whether these are 
protective of the natural populations of fish and retain their 
normal levels of ecological function. In aquaculture, a key 
problem is the management of sea cages to avoid diseases 
and environment impacts on the seabed and surrounding 
habitats. While such issues are also worldwide problems, 
they are more complex in Australia’s ecosystems because 
of the high levels of diversity and endemism in the marine 
flora and fauna, which imply a higher level of vulnerability 
to such uncertainties. For example, of the 3855 species 
of fish recorded from Australia’s continental shelf waters 
(0 to 200 m depth), 945 species (25%) are considered to 
be range-restricted Australian endemics (Atlas of Living 
Australia 2015). Since marine ecosystem quality and 
function is closely linked to diversity (Palumbi et al 2009), 
where diversity is high, even local impacts from fishing or 
aquaculture operations are potentially of high significance 
in terms of indirect effects on both the target and non- 
target populations and ecosystems. 

The direct and indirect ecological effects of fishing 
the target species are poorly understood, and this 
includes the direct impact of reducing the population 
size of the target species, typically to levels of total 
biomass between 20 and 40% of that which would have 
existed in the absence of fishing. Even where there 
has been an intensive base of scientific knowledge and 
fishery management, fishery crashes still regularly occur, 
resulting in the closure of fishing grounds, sometimes for 
decades. Australia’s school shark fishery, for example, 
was overfished for many years and the population 
remains depleted. Nonetheless 210 t was caught in 
2013 as bycatch to other fisheries, reducing the rate 
at which the school shark population might be able to 
recover from very low levels of abundance (Caton and 
McLoughlin 2000; Flood et al 2014). In aquaculture, 
there are persistent concerns about the impacts on 
local environments in many locations, including wastes 
discharge, high densities of cages/ponds, escapes, spread 
of diseases, attraction of predators, and provision of 
energy subsidy to native (and sometimes introduced) 
species that congregate around facilities, such as sharks, 
seabirds and starfish. 


Other fishing/seafood issues that also directly attract 
consumer attention include the closing of inshore 
fisheries in peri-urban areas (such as in Port Phillip Bay 
and Westernport, Vic; Cockburn Sound, WA), bycatch 
of endangered species, and the pervasive decline in 
commercial fish catch in most jurisdictions (e.g. in Western 
Australia; Figure 1). These uncertainties, together with 
the complexity of the governance structures (national, 
state, local, industry) and the dominance of commercial 
interests in management decision-making have created a 
consumer demand for independent information about the 
seafood sustainability attributes, and this has become an 
important part of purchasing decisions in Australia. 

In 2007, the Australian Conservation Foundation (ACF) 
approached us to develop a seafood ratings program 
that would identify fresh seafood products that could 
be supported by ACF in the marketplace (mainly in 
Melbourne) as being produced in an environmentally 
responsible and sustainable manner. The ACF objective 
was to be able to provide both independent and technically 
robust information to seafood consumers, so their choices 
could be informed with reliable and unbiased information 
about the ecological impacts of the available locally 
sourced products. We subsequently developed a set of 
criteria, and a decision-making process to identify and 
rate products that conform to the criteria. The ratings 
program, known as the Sustainable Australian Seafood 
Assessment Program (SASAP), was designed to focus on 
commonly available fresh seafood products, both wild- 
catch and farmed, sourced from the continental shelf, 
inshore marine ecosystems, bays, estuaries, and coastal 
rivers. Products from these coastal areas around Australia 
form a large segment of the ‘local seafood economy’, and 
are an important resource for employment and small-scale 
local business enterprises in many, if not most, coastal 
Australian towns and shore-line settlements. 

The concept of sustainability has many dimensions, 
but in the Australian context it has been interpreted 
and restated by governments within the construct of 
Ecologically Sustainable Development (ESD) as ‘... 
governments agreed that society could have both growth 
and environment protection provided decisions were 
guided by principles designed to maintain ecological integrity 
for future generations.’(emphasis added) (Burnett 2015). 
However, it appears that this key outcome objective has 
been actively and effectively avoided in a number of 
sectors, evidenced in key indicators that are persistently 
in decline: ‘...the efforts of governments, not only to 
interpret ESD but also to avoid it, by adopting a number 
of “pseudo-sustainability formulations”. This was to 
avoid the difficult trade-offs arising from the ecological 
constraints inherent in applying ESD’ (Burnett 2015). 

In the context of Australian seafood production and the 
SASAI? maintaining ecological integrity is a central attribute 
of sustainability and ESD, and should thus be a primary 
outcome targeted by activities in Australia’s fishing and 
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Figure I. Last two decades of commercial catch of seafood (fish ■ I 63 taxa, crustaceans □ 15 taxa, molluscs I 10 taxa) 
from Western Australia inshore and continental shelf waters (source: commercial fishers mandatory monthly reports, 
Annual State of the Fisheries Reports, WA Department of Fisheries; compiled annual data for the years 1999/00, 
2005/06, 2006/07 are not available in public domain). 


aquaculture sector. While ESD also embodies interactions 
within the social, cultural, recreational and business aspects 
of sustainability, achieving positive outcomes in these alone 
in the seafood sector will not achieve the ecological integrity 
objective that is fundamental to ESD. The evidence of 
persistently declining catch, the ongoing range of related 
environmental issues, and widespread evidence of declining 
indicators (Ward 2014), suggest that many policies and 
practices in the seafood sector may be inappropriately 
focused and only weakly apply precaution, and therefore 
be best classified as ‘pseudo"Sustainability’ (sensu Burnett 
2015). Such potential failure to correctly address the 
ecological integrity aspects of ESD for seafood is therefore a 
key factor in consumer interest in better, independent and 
authoritative information about seafood. 

In the environmental and ecological dimension of the 
seafood sector, we considered that the effects of the 
seafood capture/production process on the structure 
and function of target and nomtarget species, habitats 
and ecosystems can be applied as proxies for ecosystem 
integrity. To achieve sustainability and ESD, impacts on 
ecological integrity need to be minor and capable of being 
demonstrated to be constrained to a level considered by 
consumers to be acceptable as the environmental ‘cost’ of 
the production of seafood. 

Our objective in developing the SASAP is to produce 
a ratings system for seafood that is accessible to small" 
scale fishing and farming systems, is technically robust 
to provide consumers, chefs and restaurateurs with 
reliable and independent sources of ecologically relevant 
information, and would enable producers to access 
high quality technical advice if specific areas of poor 


performance are identified through the SASAP process. 
These principles guided all aspects of the SASAP criteria 
development and implementation towards an assessment 
of the extent to which a specific seafood product could 
be considered to be produced in a way that minimally 
impacted any aspect of ecological integrity. 

Here we report the results of a review and criterion 
development process focused on ecological integrity for ESD 
(sensu Burnett 2015), and provide some selected examples 
of the seafood product assessments used to pilot and refine 
the SASAP program. To guide the development of a set of 
issues to be considered, we reviewed the criterion structure 
of ten other seafood assessment programs, and the processes 
they used to make decisions and formulate evaluations/ 
recommendations. From this broad review of existing global 
practice, we derived the underpinning ecological issues and 
a process of decisiommaking suited to the type of issues and 
extent of data/information available for Australia’s coastal 
seafood products. While we found many assessment system 
objectives were framed in ecological terms, many were 
assessed using performance benchmarks derived to satisfy 
production objectives rather than ecological objectives and 
standards. Therefore, here we present an interpretation of 
the relevant issues in an overtly ecological context, and 
resolve those into indicators/standards with benchmarks 
that are appropriately framed to match available data/ 
information streams, assess the ecological issues, and 
provide ratings suitable for communication to interested 
consumers. 

We also reviewed the structural approach for decision" 
making in several of the systems, to inform development 
of a decisiommaking process for the SASAP that is cost" 
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effective for local'scale producers, and achievable in the 
context of typically available information/data about the 
local species and the ecosystems. The SASAP system was 
then taken to pilot implementation, including assessment 
of a range of farmed and wild'catch species, presentation 
of our findings in the public domain, and engagement 
with a number of promotional events involving various 
seafood resellers and consumer interfaces to gauge the 
level of producer, reseller and consumer acceptance and 
effectiveness of the SASAP 

Criteria Development 

To establish an initial set of issues to be considered for 
SASAP criteria, and to assist with framing the levels 
that should be encoded into the performance gradient 
for each indicator, we reviewed the details of ten 
major seafood sustainability initiatives from government, 
industry or NGOs with details available in the public 
domain (Table 1). The criteria and indicators of each 
sustainability program were considered for application 
in the context of the Australian environment and 
jurisdictions, based on the published procedures for 
evaluating the performance of the different forms of 
seafood sustainability and certification/rating systems 
(Leadbitter and Ward 2007; Ward 2008a,b; Phillips and 
Ward 2009; Ward et al 2011; Pitcher et al 2013). 

After evaluation of each of the programs for direct 
applicability in the Australian context (Table 2), we adopted 
the broad approach and rating system of the Seafood Watch 
(SW) program, and selected a number of SW criteria as the 
initial basis for the SASAP Specific details of the criteria, 
and the performance grading encoded into the SW system, 


were modified to recognise the different circumstances that 
prevail in Australia compared to the USA, where most of 
the products assessed by SW at that time were produced 
or marketed. As a result, for the SASAP for example 
we amended the SW formulations of both criteria and 
performance gradings in assessing the availability and use 
of scientific advice within the fishery management system. 
Other SW criteria and performance gradients were adapted 
to better suit the highly datadimited situation of most 
Australian coastal fisheries by using simpler empirical and 
precautionary ‘rule of thumb’ indicators where resolution 
was considered to be appropriate. 

After the initial draft, SASAP criteria/indicators were 
internally tested using a series of workshops to reach 
consensus with NGOs and industry representatives 
about both the form of the criteria to be used and the 
performance levels to be encoded into the assessment 
system. This included further refinement of the application 
of precaution, the proxies and surrogates that may be 
derived from empirical data used to estimate performance 
in key areas, and the grading scales we expected to apply 
in assessing a seafood product. 

Results 

The key ecological issues identified in the reviewed 
programs (Table 2) as of concern to Australian seafood 
consumers were: 

• Wild'catch Products: the impact of fishing on target 
and bycatch species, on ecologically'dependent species, 
and on associated ecosystems and habitats 


Table I. Seafood assessment systems reviewed to identify consumer issues in relation to Australian issues 


Program 

Product, region focus, sector 

Aquaculture Stewardship Council (ASC) 

(www.asc-aqua.org) 

Farmed products, global, NGO 

Australian Bureau of Agricultural and Resource Economics and 
Sciences (ABARES) & Fisheries Research and Development 
Corporation (FRDC) (www.fish.gov.au) 

Wild-catch and farmed species, Australia, 
government + industry 

Australian Government Department of the Environment, Environment 
Protection and Biodiversity Conservation Act 1999 Guidelines for the 
ecologically sustainable management of fisheries (EPBC) (www. 
environment.gov.au/marine/fisheries) 

Wild-catch and farmed species, Australia, 
government, environment protection 

Australian Marine Conservation Society (AMCS) (www. 
marineconservation.org.au) 

Wild-catch and farmed species, Australia, NGO 

Friend of the Sea (FOS) (www.friendofthesea.org) 

Wild-catch and farmed species, global, NGO 

Marine Conservation Society UK (MCS-UK) (www.fishonline.org) 

Wild-catch and farmed species, UK, NGO 

Marine Stewardship Council (MSC) (www.msc.org) 

Wild-catch fisheries, global, NGO 

New England Aquarium, Boston, USA (NEAQ) 
(www.neaq.org/conservation and research) 

Wild-catch and farmed species, USA, NGO 

Ocean Wise, Vancouver Aquarium, Canada (www.oceanwise.ca) 

Wild-catch and farmed species, Canada, NGO 

Seafood Watch, Monterey Bay Aquarium, USA (SW) (www.seafoodwatch. 
org) 

Wild-catch and farmed species, USA, NGO 
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• Farmed Products: the location/site impacts of aquaculture, 
genetic impacts of escapes and local trophic subsidies, 
diseases, chemical contamination, and the sustainability 
of feedstock, including the secondary impacts on baitfish 
populations such as use of ‘trash’ fish. 

In wild-catch fisheries worldwide, there is widespread 
use of complex population-based models, typically 
using production objectives and standards for surplus 
yield and self-sustaining populations as the basis to 
determine an appropriate level of fishing effort and 
consequent catch of target species. In Australia, the 
increasing use of highly complex stock assessment 
models based on limited empirical data has had several 
potentially undesirable ecological consequences for 
the populations of species being fished. These issues 
include the lack of adequate precaution in setting of 
acceptable levels of effort/catch, permitting population 
levels to be routinely reduced to levels that are likely 
to have widespread ecological impact on structure and 
function of coastal ecosystems, as well as a high risk 
of failure to adequately maintain acceptable levels 
of spawning biomass for production purposes (even 
though production may be optimised in the short term). 

Typical potential consequences of managing fish populations 
for production purposes rather than for their role in 
maintaining the integrity of ecological systems include: 

• reduction of the population biomass of fished species 
to around 30% of the expected unfished biomass 


(commonly held lower for many species, higher for a 
few - Flood et al 2014); 

• truncating the structure of fished populations to comprise 
mainly the juvenile and just-mature individuals—e.g. in 
the coastal waters of NSW, Mulloway (Argyrosomus 
japonicus) lives to at least 24y, and possibly up to 45y, 
yet the catch is persistently dominated by small and 
immature fish (98% of the commercial catch is <5y 
old fish), indicating an overfished population. Until 
recently, in this fishery the minimum legal length was 45 
cm, much smaller than the size at sexual maturity (—70 
cm) for females (Industry and Investment NSW 2010) 

• likely resulting in structural and functional population 
level impacts on species ecologically connected to the 
target species (as considered to occur elsewhere for 
fished species and ecologically dependent species - 
Smith et al 2011; Froese et al 2016) 

• contributing to genetic changes resulting in loss of 
population resilience, earlier maturation of individuals 
and hence progressive reduction in the dominant size/ 
age class in the population (Melville-Smith 2011). 

As a result of such issues, and because many of the fisheries 
addressed by the SASAP are small (in terms of catch) 
and consequently have a limited base of knowledge and 
capacity for research, the SASAP criteria and indicators 
make extensive use of proxies and surrogates. The SASAP 
also sets conservative precautionary benchmarks for 


Table 2. A summary of the attributes of selected sustainability assessment programs (from Table I) relative to the 
requirements for a robust and effective ecological sustainability assessment program for Australia’s coastal and small-scale 
seafood products. (Note that this is a summary of the attributes of the systems as they existed in 2007-08, and they may 
have changed since that time, including resolution of the deficiencies outlined here.) 


Programs assessed 

Criteria used for assessment 






1. Publicly 
available 
decision 
system and 
criteria 

2. Consistently 
applied high 
standard for 
species in 
ecosystems 

3. Compatible 
with small-scale 
producers 

4. Independent 
evidence- 
based and 
peer-reviewed 
assessments 

5. Assessment 
interaction 
with producers 

6. Data, 
information 
requirements 
match those 
available in 
Australia 

ASC 

yy 

y 

n 

yy 

yy 

n 

ABARES/ FRDC 

y 

n 

n 

y 

y 

yy 

EPBC 

y 

y 

n 

y 

y 

yy 

AMCS 

n 

? 

? 

y 

n 

? 

FOS 

n 

? 

y 

? 

yy 

? 

MCS-UK 

n 

? 

? 

y 

yy 

? 

MSC 

yy 

y 

n 

yy 

yy 

y 

NEAQ 

y 

y 

? 

y 

yy 

? 

Ocean Wise 

n 

? 

? 

? 

? 

? 

sw 

y 

y 

y 

yy 

y 

? 

SASAP (this system) 

y 

yy 

yy 

yy 

yy 

yy 


Key: yy = highly suitable; y = suitable to some extent; n = suitability too limited or too difficult to apply; ? = suitability 
unable to be determined because of lack of adequate publicly available information. 
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indicators and default grades where the knowledge base 
is too weak to assign defendable evidence'based grades. 
These inform the decision-process with a pragmatic set 
of indicators and benchmarks designed to provide a 
rapid and ecologically sensitive estimate of the impacts 
in the issues we considered to be associated with the 
coastal fisheries and aquaculture systems. For example, 
in assessing the impacts of targeted fishing for black 
bream (A canthopagrus butcheri) in Gippsland Lakes, 
SASAP decisions about the magnitude of population 
impacts were informed by research data that identified 
recruitment events propagating through the time-series 
of population structure, as reflected in the age/size 
structure of fish in the fishery catches. While there were 
concerns about the short-term trend for reductions of 
older fish in the catch, this was considered to be within 
historic patterns (and potentially related to the dynamics 
of river inputs to the lakes system) (Kemp et al 2013). 

The SASAP decision system for assessing the seafood 
products comprises a set of criteria, sub-criteria, 
indicators and performance benchmarks framed at 
the population and ecosystem level. For wild-caught 
products, the criteria cover the three central elements 
of the sustainability decision problem (Figure 2): status 
of wild stocks (target and byproduct 1 species); bycatch; 

I Bycatch is any plant or animal other than the target species that is taken by 
fishing gear or damaged during fishing operations. Byproduct is marketable 
species that are taken incidentally by the fishing gear and retained for sale. 
While some forms of bycatch can be returned alive to the ocean if they 
are handled carefully delayed discard/nelease mortality is high for many 
species, and predators are often entrained on fishing vessels to feed on 



Figure 2. Overview of the SASAP Criteria and Sub-criteria 
assessment hierarchy for wild-caught seafood products 


and impacts of fishing on habitats and ecosystems 2 . For 
farmed products, the criteria cover the four equivalent 
central elements (Figure 3): disease and parasite risk; 
siting and cumulative impacts; wildlife interactions; and 
sustainability of wild-sourced stock and food sources. 

Decision Procedures 

In any assessment system that evaluates performance, 
the criteria need to be set in a performance grade using 
performance indicators relative to benchmarks with specified 
thresholds between classes (grades) of performance. Where 
possible, such systems should also provide specific guidance 
about both interpretation of the thresholds and an example 
set of interpretations and decisions that have been reached 
in a prior cycle of the decision process to demonstrate 
how the criteria have been applied in a specific situation 
that may have some form of general applicability (Ward 
2008a). The thresholds may be set as pass/fail, or may be 
a graded set of thresholds of performance set in discrete 

discards, resulting in high levels of unintended discard mortality for some 
forms of bycatch. Catch and release is therefore not necessarily a practice 
with insignificant mortality on target or bycatch species. 

2 Gear types that make contact with the seabed may have direct physical 
impacts on sedentary assemblages of plants and animals. Ecosystem 
impacts may occur when large proportions of a local population are 
taken by fishing gear; potentially disrupting local trophic relationships, 
energy flows, social behavior in protandrous or protogynous species, 
or other behavioural aspects of reproduction, such as aggregation for 
spawning, that may have much broader consequences for a population or 
ecosystem. Some forms of sedentary fauna are slow-growing and long- 
lived, and even low intensity impact of fishing gear on these assemblages 
may have persistent and ecologically important consequences. 



Figure 3. Overview of the SASAP Criteria and Sub¬ 
criteria assessment hierarchy for farmed seafood products 
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categories (such as percentage bands). The greater the 
number of thresholds established, the greater the resolution 
achieved in the assessment and its outcomes. However, at 
each increase in number of categories there is the parallel 
responsibility to ensure that the performance being assessed 
in each category is capable of being discretely resolved from 
the adjacent categories using the type of evidence likely to 
be available. In data-poor situations, the lack of information 
and data will preclude the use of fine scales of resolution. 
Performance bands must therefore be set that maximise the 
accuracy in decision criterion and decision outcome even 
if precision is reduced. And finally, where there turns out 
to be no useful data/knowledge that enables an informed 
and evidence Tased decision to be made in relation to an 
indicator, the decision process must also specify how to 
treat that situation, such as assigning a default grade that 
is appropriately precautionary in the context of the specific 
decision problem being considered. 

Given the limited data and knowledge base for many of 
the products being assessed, the SASAP criteria were 
established to match the three SW thresholds (red, 
yellow, green, and their associated language statements). 
Within each criterion in the SASAB there is a set of 
sub-criteria (Figures 2 and 3), for each of which there is 
a performance indicator set with appropriate language - 
based grading guidance relative to an expected level 
of performance at the threshold. The number of sub- 
criteria that can be assigned as ‘Unknown’ is capped, 
above which a product is assigned with a Critical 
Concern (eliminating the product from the assessment), 
applying a precautionary base to the assessment process. 
The proportion of red, green, yellow and unknown 
indicator grades assigned to a product in the sub- 
criteria is proportionally balanced between farmed and 
wild-caught products. This is to ensure an equitable 
assessment structure that will minimise the risk of 
different performance standards between farmed and 
wild-caught products, and the consequent risk that 
environmental impacts may become exported from one 
sector to the other by consumer choice. Together with 
a defined structure for aggregating the performance 
grade from each indicator into a final decision for the 
product, this constitutes the decision structure adopted 
by the SASAP in order to provide an explicit, equitable, 
precautionary and transparent basis for any final product- 
level grade. Table 3 provides an example of the decision 
hierarchy for farmed products; an equivalent hierarchy 
was constructed and applied for assessment of wild- 
caught products. 

In the SASAFJ the process of assessing and grading 
products is conducted by the Science Reference Panel 
(SRP) in an iterative process with several checks and 
balances, including error-checking and a procedural 
fairness loop. The key elements of this decision process 
are the consensus decision-making process using a set of 
performance indicators with clear grading thresholds and 
specific precautionary default decisions to be assigned in 


the event that relevant and assessable data/information 
is not available to the SRP to inform an evidence-based 
decision about the performance level of an indicator. 

The Science Reference Panel (SRP), the primary decision¬ 
making body for gradings in the SASAP consists of seven 
technical experts drawn from the Australian science and 
fisheries academic and applied research community who can 
demonstrate an independence from the fishing or farming 
sector. Conflicts of interest within the SRP when they arise, 
are documented and SASAP decisions do not involve any 
member of the SRP who declares such a potential conflict 
of interest. The SRP members are identified in the public 
domain, and are collectively responsible for ensuring the 
fidelity of the gradings and the final SASAP decisions. Only 
products meeting the SASAP Green or Yellow grades are 
posted into the public domain, to avoid the concept of a 
‘black-list’, and to enable producers who wish to upgrade 
their performance to engage privately with the SRP to 
demonstrate improvement without the complications of a 
public performance profile. 

Products to be assessed are chosen on a non-voluntary 
basis - the SRP determines which products will be assessed 
for the SASAP without consultation with the relevant 
producer. Products for assessment are chosen because 
they represent important components of local ecosystems 
and habitats, and make at least a modest contribution to 
the local seafood economy. The procedures for product 
assessment follow a specified pathway to ensure the 
assessment for all products is systematic (Table 4). All 
draft product grades and the associated decision-basis 
are reviewed by at least one technical peer-reviewer, 
and by the producer prior to public release of a product 
grading. The SRP reviews all comments and responses to 
amend and confirm as necessary the details of the product 
decisions prior to public release. 

Typical seafood products that have been assessed as 
meeting the ecological integrity criteria of the SASAP at 
the Green or Yellow level in the past include: 

• Red Emperor from the Pilbara trap fishery—this is a 
highly-targeted low-impact fishery operating on the 
North-west Shelf of Western Australia, with very 
limited bycatch; compared to adjacent trawl fisheries 
for the same species, the trap fishery is benign; 

• farmed Mussels from Port Phillip Bay, Victoria—this 
farming system requires no feed inputs (the mussels 
feed on the local wild plankton), has minimal bottom 
contact or provisioning of surfaces as habitat to support 
invasive species, and has only minor site impacts; 

• seacage Barramundi from Cone Bay, West Kimberley— 
these fish are farmed in an area remote from other 
activities, in a high-flow bay that provides a large 
assimilative and dispersive capacity for the fish wastes, 
with no nutrient sensitive habitats in close proximity. 
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Table 3. Example of the decision hierarchy established within the SASAP to assess farmed seafood products, including 
the decision rules for aggregation of performance from the level of indicator to product grade. 

Sub-Criterion Grading 


Criterion 

Sub-criterion 

Indicator 

Grade assigned 

1. Disease and 
Parasite Risk 

1.1 Risk of 
spreading disease 
and parasites to 
native species 

There is a low risk of introduction, amplification or transmission; 
effective controls are in place; independent research/monitoring 
shows no evidence of introductions, amplification or retransmission 
from the facility; and, there is substantive physical separation from 
likely receptor species (all these must be satisfied) OR there are 
intensive recirculating systems with effective controls on effluent 
release and there is substantive physical separation from likely 
receptor species (all these must be satisfied) 

Green 

There is a low risk of introduction, amplification or transmission; 
limited controls are in place; and, there is substantive physical 
separation from likely receptor species (all these must 
be satisfied) OR Unknown (there is inadequate evidence 
available to inform a judgement) 

Yellow 

There is a moderate or high risk of introduction, amplification or 
transmission; OR systems with untreated or ineffectively treated 
water exchange to outside environment near likely receptor 
species; OR likely receptor species are heavily depleted (below 
20% of unfished level), or “endangered”, “threatened” or 
“protected” under any state, federal or international law (if any 
of these are satisfied the grade is assigned) 



Criterion-level Grading 

Criterion 1 

Disease and Parasite 
Risk 

Sub-criterion l.l Risk of 
disease and parasites to 
native species 

Sub-criterion 1.2 Input and 
use of chemicals 

Sub-criterion 1.3 
Management effectiveness 

Green 

Green 

Green 

Green 


Green 

Yellow 

Green 


Yellow 

Green 

Green 


Yellow Yellow Yellow Green 

Green Yellow Yellow 

Yellow Green Yellow 



= may be either G,Y or R, subject to other rules taking precedence. 


Product-level Grading 


Product Classification Criterion Level Achievement 


Green 

Any two or more Green and no Red grades 

Yellow 

FourYellow; OR any one Green and no Red grades 


One or more Red grades 

Critical Concern 

Any Critical Concern** 


** Under Criterion I Disease and Parasite Risk a farmed product is classified as having a Critical Concern if there is evidence 
of the product associated with an ecologically significant disease or parasite introduction within the past 5 years. A product is 
also considered to have a Critical Concern if more than two of the sub-criteria are determined by the SRP to be ‘Unknown’. 
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Table 4. The SASAP decision procedure workflow. 


Stage 

Action 

Outcome 

Documents 

1. Initial Listing 

SASAP researcherdevelops initial 
list of products for preliminary 
screening 

Initial List: product name, 
type, producer; location 

Major research documents & 
data availability; major issues 
- stock, bycatch etc; Critical 
Concerns (CC) identified 

2. First Screen 

Science Reference Panel (SRP) 
chooses products for initial 
evaluation 

Products Under Assessment 
list 

Document and information 
base by product; potential CC 
identified 

3. Assessment Products 

Assessments List is reviewed by 
SRP (remotely) 

Final Assessments List 

Additional product information; 
sensitive issues; CC detail 

4. Assessments 

conducted 

SASAP researcher conducts 
product assessments and 
compiles draft assessment 
reports 

Initial Draft Assessment 
reports for each product 

Initial Draft Assessment Report 
for each product (confidential) 

5. SRP assessments 
workshop 

SRP convenes in workshop 
to consider, revise, approve 
assessments 

SRP approved draft 

assessment report for each 
product, identifying any 
further issues, uncertainties 
to be reviewed, revised 

SRP Initial Draft Assessment 
Report for each product 
(confidential) 

6. SRP final draft reports 

SRP considers revised 

Assessment Reports, approves 
release to reviewers 

SRP Draft Assessment 
Report approved for release 
to Peer Review 

SRP Review Draft Assessment 
Report 

(confidential) 

7. Peer Review 

SASAP distributes draft 

assessment reports to at 
least one independent expert 
reviewer 

Peer review report for 
each product, revised as 
necessary 

SRP Peer Reviewed Draft 
Assessment Report for each 
product (confidential) 

8. Producer Review 

SASAP distributes peer-reviewed 
draft assessment reports to the 
producer for comment 

Producer comments on 
draft assessment report 
(procedural fairness loop) 

SRP Draft Assessment Report 
for each product (confidential) 

9. SRP final assessment 
reports 

SRP reviews, amends, finalises full 
assessment report (remotely) 

Final Assessment Report 
issued to producer; including 
clarifications of any specific 
weaknesses, options for 
improvement 

Final Assessment Report 
(confidential) 

10. Public Distribution 

Summary of the product findings, 
with grading, placed on the 
SASAP website. 

Final decision of SASAR 
summary of features, 
including duration timeframe 

Final Decision issued to website 
(public domain) 


The full list of products that have been assessed as Green 
or Yellow within the SASAP pilot project, together 
with details of the SRP and the SASAP Criteria are 
available at < aussiegoodfish.weebly.com>. Note that the 
SASAP requires a full re-assessment each 3 to 5 years, 
depending on the specific circumstances of each product. 
The product gradings of the SASAP pilot project have 
not been renewed and therefore have now all expired, 
pending renewal of SASAP funding. 

Market Testing 

To assess the practical value of the SASAP decision 
process, the relevance of the criteria, and the direct 
interest of consumers in the SASAP ratings system, a 
marketplace project was conducted at South Melbourne 
Markets in 2013-14 (Figure 4). Market research analysts 
were engaged by ACF to interview consumers and 
resellers, and to report on their perceptions of the SASAP 
and the extent of engagement and interest from various 
points in the local seafood supply chain. The findings 


indicated that the SASAP was well accepted, and all 
levels in the supply line responded favourably to both the 
technical ratings and their representation in the market 
(Frankel et al 2013; Box 1). The local seafood industry 
had also responded positively, and, in 2011 the pilot 
SASAP project received the Seafood Industry Victoria 
2011 Award for Seafood Industry Promotion. 

Key Differentiating Attributes 

The SASAP is different from the other programs we 
reviewed in five aspects that appear to be very important 
in the assessment and performance grading of locally 
produced seafood in Australia. These differences, apart 
from the higher level of accessibility and relevance to local 
producers, mainly distinguish the SASAP because of its 
higher effectiveness in grading products for their impacts on 
ecological integrity. This arises from our focus on ecological 
issues, making a contribution to ESD, all of which appears 
to be a close match to both the consumer perception and 
the definition of ecological sustainability and ESD. 
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Choose Local, Choose Sustainable 
—Protect our Oceans 


Seafood ss a staple on the Australian 
table. But what looks great on your 
pLate can be even fishier than it appears. 

Australia imports roughly 71% of its 
seafood. We don't always know the 
source of the seafood we're eating or 
if it was harvested within the natural 
limits of our oceans. 

Choosing fresh, local and sustainable is 
the best way to shop with confidence. 


Leading marine scientists have sized up 
Victoria's fishers to make sure that their fishing 
practices have minimal impacts on the region's 
stocks, bycatch and habitat. 

Scientists work closely with Port Phillip Bay and 
Corner Inlet fishers during the sustainability 
assessments to create a fish wish list that you 
can trust, hook, line and sinker. 

Find the full list of sustainable seafood at: 
acfon l in e,o rg. au/seafood 



King George whlttng 

flmft Ca*wr lute and P«I Philip Uy 



Stack bream 

From (jippitind Uloc* 



Silver trevaily 

From Coraer IrStrt and Port Philip Bay 



Snapper 

From Port Philip Bay 



Rock ft at head 

From Canter Intel 



Southern cilamari 

FTOm Corner Irtlet and Port. Philip Say 


nine Oeerft wMlni It Oftlf foimtJ 
In AHtnfr In hJ]l and 

estuaries. Ihn Perl FtiilLIp Boy 
^shey diet tarcfollyselcitcd haul 
Mine* add nwth nwt to ranch 
whiiiSn.g:*Sdi mWm*t Imp* eta. 
uWtmpg am caught ft cl» Co'«r 
Britt Mirny udini small bun and 
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(JTHMli and 


Blank bmm tu™ Inm cju&I* by 
com martial MlWra ift [h* GippSjmd 

.tUl ift VlfiWria Jiftffl EtW 

Law K HvM In wunrltt 

iMhvn hnoitia ud Ifv* 
«« » bn* m jo yum. in 

1 ha filpjKlnrd taken ima nfwtahwrl 
pa, Oh hurling aid hand wiring 
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In Pan Phillip gay Eh* Mw* 
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Figure 4. Poster used to engage wholesalers, retailers and consumers with the market testing program conducted at 
South Melbourne Markets. 

(Reproduced with permission from the Australian Conservation Foundation and the University ofTechnology Sydney). 

12 ^ UStra ^o/ogist vo/ume 39 (/) 2017 

Theme Edition: Zoology on the Table 



Australia’s coastal fisheries and farmed seafood 


First, the SASAP considers products rather than species 
or stocks as the unit of seafood that is assessed. This is 
more relevant for the ‘local seafood economy’ because 
some species are fished/farmed in different ways in 
different jurisdictions, and even at some locations, and 
this may confer different sustainability characteristics 
on a species. The SASAP therefore assesses wild-catch 
products defined by species, the form of fishing, and by 
location. In the case of farmed products, products are 
defined by species and by local producer or farm. So, for 
example, Red Emperor is caught by both a trap fishery 
and a trawl fishery on the North-west Shelf, but the 
SASAP assessment only endorsed Red Emperor from the 
trap fishery (the trawl fishery was not part of the pilot 
assessment). This focus on products enables the SASAP 
to be specific and directly relevant to key elements of 
the local seafood economy. Also, direct post-assessment 
engagement with producers is easier, and helps to develop 
a common language and understanding of the ecological 


issues, and connections to local consumer confidence, 
employment opportunities, and ongoing support for 
intergenerational family businesses and social structures. 

Second, the SASAP criteria and indicators are uniquely 
focused on ecological issues and the impacts associated 
with local fishing activities. Empirical attributes of fished 
and farmed species populations are used in the SASAP to 
establish benchmarks and standards for seafood products 
that broadly represent consumer expectations about 
ecological sustainability, and can be used to report on 
the actual intent of ESD, reducing the scope for ‘pseudo - 
sustainability’ policies and programs in the seafood sector. 
The commonly available data, although sometimes highly 
limited, can be used in the SASAP as proxies to inform 
the empirical estimates of performance with an acceptable 
level of accuracy and precision within the grading system, 
and this is coupled with a representation of uncertainty 
that provides for precautionary decision outcomes. Lack 


Box I. Market analysis of the SASAP in Victoria (from Frankel et al. 201 3; extract reproduced with permission of the 
Australian Conservation Foundation) 


Program Overview 

The strength of the SASAP is that it assesses local species, caught by local small-scale fishers, thereby establishing a clear 
transparent link between the environment where the fish is caught, the supply chain through which it passes, and the 
end-consumer In most cases the consumer can closely relate to the place where the fish is caught - eg. a Melbourne 
consumer eating fish caught in the Port Philip Bay 

Supply Chain Issues 

When working within the model of the local food economy it is relatively easy to manage the supply chain relationships, 
since these relationships are already in place and many of the people involved are known to each other and have a history 
of co-operation.The key is to keep the scale small and local.Through partnering with producers, wholesalers and suppliers 
in the supply chain it is possible for a program to source and market local, sustainable caught, fresh product. 

Consumers 

People we spoke with enjoy eating local fish and seafood. Seafood is viewed as a premium food product. They have 
varying views about what exactly is local and what exactly the definition of fresh is, but by and large their views fit with 
Victorian fish being local in Victoria, and 24 hours or thereabouts, being “fresh”. 

They want to support the local food economy It is viewed by many as an intrinsically good thing. Others are not invested 
in this idea, but no one is opposed.They respond well to stories about the local food economy the fishers, and the ecology 

Fishing sustainability is on the radar of ecologically concerned consumers - but it is more relevant for some than others. 
While local fishing sustainability is not on their radar; they easily understand the proposition and recognise it as adding 
value at the level of the local economy, ecology and as a premium product from a consumer perspective. 

Ecologically concerned consumers of seafood tended to be regular shoppers at various local Melbourne markets - 
Preston, Footscray Prahran, South Melbourne, Dandenong. 

Summary Findings 

As we progressed with the research we realised that we were exploring a submerged story about the local seafood 
economy’. People experienced in developing and marketing land-based local food economies had useful insights to 
complement the knowledge of those working in the fishing and fish marketing industries.The public want to hear the 
story of the local seafood economy 

They want to eat the seafood.They want to support and maintain a healthy system of fishers and fish, and they will pay 
a premium for it. 

Sources 

The research, analysis and findings are based on desk studies, and 15 in-depth interviews and two focus groups with 
industry stakeholders and consumers: fishing industry bodies, fishers (Lakes Entrance, Port Phillip Bay, Corner Inlet), the 
state government fishery agency, local government (Melbourne, Port Phillip, Mornington), South Melbourne Markets, 
trend experts, social enterprise entrepreneurs, and corporate caterers. 
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of information and a high proportion of unknowns default 
to a precautionary grading outcome, rather than being 
mainly assessed through risk procedures or simply allowed 
to pass through the assessment system in a neutral manner. 

Third, the use of a single public-domain expert-jury for all 
assessments, rather than various certification accreditation 
bodies that are contracted by producers, governments or 
NGOs for each assessment. Any significant form of 
financial control over certification processes enhances 
the risk of a controlling relationship and frame bias being 
developed in sustainability assessments. A typical result 
of this situation is the application of different assessment 
standards by accreditation bodies based on a different 
interpretation of the expected performance required by 
the standard, which may tend to systematically favour one 
specific form of interpretation over another (Ward 2008b). 
Producers and governments purchasing accreditation 
body services typically go ‘certifier shopping’, to seek the 
most favourable grading outcomes in exchange for an 
agreed financial return, or priority access to other related 
incentives such as bids for other activities within the 
industry sector. The SASAP assessments are not directly 
funded by producers, industry bodies or governments, 
limiting the opportunity for undue external influence on 
the findings. However, the corollary is that funding for the 
SASAP operations has to be sourced from independent 
3rd party donors, and maintaining a consistent flow of 
funding support and related program of assessments can 
therefore be a significant problem. 

Fourth, the SASAP conducts non-voluntary assessments. 
Products for assessments are chosen because they represent 
important components of local ecosystems and habitats, 
and make at least a modest contribution to the local seafood 
economy. This also, as above, avoids the requirement for a 
seafood producer or industry body to establish a structural 
(or financial) arrangement with an accreditation body 
to conduct contracted assessments. The SASAP non¬ 
voluntary assessment model is typically based on use of 
public domain information, and largely avoids the need for 
access to privileged information (which may be available 
under a contracted arrangement but will not have been 
open to external scrutiny and verification), instead relying 
on public-domain and more openly contestable evidence as 
the basis for the SASAP grading outcomes. While there is 
occasionally a need for commercially sensitive knowledge 
(such as commercial earnings) to be held as confidential, 
the use of public domain knowledge in the SASAP 
assessments encourages producers to make all relevant data 
and information available in the public domain, increasing 
both the level of transparency in an assessment and 
consumer-confidence in the outcome. 

Finally, the SASAP is a low-cost assessment system 
compared to almost all the other systems we reviewed and 
requires only minimal engagement (and hence cost) by a 
producer, unless they wish to present supporting data and 
information. This is principally because the assessments are 


conducted by the expert jury based on public domain data/ 
information, with annual desk-review for a maximum of 4 
years, and a minimal requirement for documentation of the 
findings beyond the reasoning behind the grade awarded 
to each individual criterion and the product. This makes 
the SASAP accessible and relevant to small-scale seafood 
producers marketing their products locally. This focus on 
local products also largely precludes the need for extensive 
chain of custody audits, as local marketplaces are usually 
well-informed about the exact source of fresh produce, and 
verification of specific practices is usually easy and robust 
given short supply lines and local knowledge amongst the 
fishing and farming industries. The local connections to 
seafood producers also enables small research studies to be 
easily established, focused specifically on matters important 
for the assessment and providing targeted assistance to the 
producers at low cost. Local products also minimise “carbon 
cost” of seafood sourcing, although this isnt directly part of 
our assessment process. 

Conclusions 

There is a currently unmet demand from consumers for an 
independent (from government and the industry) ratings 
system for Australia’s locally produced seafood that is 
technically robust, transparent, non-voluntary and directly 
addresses ecosystem integrity. We base this conclusion 
on the high level of acceptance and endorsement by 
consumers expressed during the pilot marketing project 
for the SASAP in the South Melbourne Markets, and the 
endorsement and a marketing award for the SASAP from 
the local seafood industry. 

The development and practical application of the SASAP 
demonstrates that a set of carefully chosen and robustly 
applied empirical proxies can be used to assess the 
ecological impacts of fishing and aquaculture operations. 
While the resolution of these proxies can be limited, their 
accuracy and precision is still adequate, given a set of well- 
constructed decision criteria and precautionary default 
gradings, to enable a robust and defendable assessment of 
the ecological impacts of production of local seafood that 
matches consumer expectations. 

The development and pilot implementation of the 
SASAP has confirmed that there are small-scale coastal 
fisheries that demonstrably conform to high standards 
of ecological sustainability, even though they are not 
certified by a major international ‘sustainability’ program. 
It is clear then, that the lack of a major ecolabel or 
accredited performance rating does not necessarily imply 
a lack of ‘sustainability’ of these small-scale fished and 
farmed products, rather it may imply a lack of access to an 
expensive certification program. 

Overall, we observed significant frame-bias in respect of 
ecological issues in most of the assessment programs we 
reviewed here, including industry-leading programs. We 
consider that, as the human and climate change pressures 
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increase on Australia’s marine species and habitats, it will 
continue to be important to properly inform consumers about 
ecological impacts of their seafood choices. Government 
and industry ‘sustainability’ guarantees and compliance 
with the principles of ESD appear to have avoided the core 
ecological issues, and be more in keeping with the more 
general ‘pseudo-sustainability’ (sensu Burnett 2015) policies 
adopted to implement ESD. Balanced information about 
the ecological impacts associated with seafood production 
is also important as Australian consumers continue to 
contemplate their choices between imported seafood and 
locally sourced products, and particularly to avoid exporting 
any excessive impacts of seafood consumption to sources 
outside Australia. Despite this, an ecologically based 
affordable and independent assessment process for seafood, 
linked to consumer information systems, remains an elusive 
goal in the Australian seafood consumer marketplace. 

In the short term, while we await better government, 
NGO, and possibly industry leadership in these areas, we 
offer a few consumer tips to draw on when you next want 
to make a thoughtful choice of a seafood product (Box 2). 


Box 2. Some leading questions that consumers can ask of 
their seafood reseller at a point of sale 


• What species is this product (name standards are 
not mandatory)? 

• Where does this product come from (country 
region, state)? 

• Which fishery or farm is the source (reliable 
suppliers will always know)? 

• How is the product caught or farmed (what type of 
fishing gear; sea-cages; land-based ponds)? 

• Is there a (current) sustainability assessment 
conducted by independent (of industry or 
government) and expert (with ecological expertise) 
authority and what did they find (their ratings)? 

• Who pays for these environmental assessments and 
reports if they are done (government, industry or 
3rd parties)? 

• Is all the sustainability information easily available in 
the public domain (and if so where can I access it)? 
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